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Abstract 

Given a thermodynamic process which carries a system from one equilibrium 
state to another, we construct a quantity whose average, over an ensemble of 
microscopic realizations of the process, depends only on these end states, even 
if at intermediate times the system is out of equilibrium. This result: (1) can 
be used to express the entropy difference between two equilibrium states in 
terms of an irreversible process connecting them, (2) leads to two statistical 
statements of the Clausius-Duhem inequality, and (3) can be generalized to 
situations in which the system begins and/or ends in nonequilibrium states. 

Keywords: irreversible processes 

PACS:05.70.Ln, 05.20.-y, 82.60.-s 

LAUR-98-563 



1 



Typeset using REVTpjX 



The Clausius-Duhem inequality of classical thermodynamics - a statement of the Second 
Law - applies to thermodynamic processes during which a system evolves from one equilib- 
rium state (A) to another (B). It asserts that the integrated heat absorbed by the system, 
divided by the temperature at which that heat is absorbed, is bounded from above by the 
net change in the entropy of the system: 

J* ^t< AS = s B - s A . (i) 

By "thermodynamic process", we have in mind a situation in which the system is brought 
into thermal contact with a sequence of heat reservoirs at different temperatures, one at a 
time, while one or more external parameters of the system are varied with time (see Fig.|l]); 
the denominator in Eq.|I] denotes the temperature of the reservoir from which the system 
absorbs a quantity of heat dQ. In general, the process is irreversible: it is carried out over a 
finite time with a finite number of reservoirs, and the system evolves, from A to B, through 
a sequence of non- equilibrium intermediate states. 

The aim of the present paper is a classical, microscopic analysis of such "Clausius- 
Duhem" processes, explicitly accounting for all degrees of freedom involved. This analysis 
will follow a statistical approach: we will consider an ensemble of microscopic realizations 
of the thermodynamic process. Each realization (described by a trajectory specifying the 
evolution of all the degrees of freedom which make up the system of interest and reservoirs) 
represents a possible "microscopic history" , consistent with the macroscopic prescription for 
carrying out the thermodynamic process. 

A statistical ensemble of realizations implies fluctuations - from one realization to another 
- of various quantities of physical interest. In taking a microscopic approach, therefore, we 
will be interested in the statistical distribution (over the ensemble of microscopic histories) 
of values of quantities such as J B dQ/T. Working with the assumption that the system of 
interest begins and ends in equilibrium states (A — > B), we will construct a quantity whose 
average, over the ensemble of realizations, depends only on those two states, and not on the 
intermediate evolution of the system. This result, Eq.[] below - the central result of this 
paper - is valid even if the system is driven far from equilibrium at intermediate times. We 
will argue that this result can be viewed as the generalization - to irreversible processes - 
of the well-known identity which relates AS* to an arbitrary reversible process from A to 
B (Eq.[IUJ). As we will show, the central result of this paper allows one to express AS in 
terms of an arbitrary irreversible process from A to B (Eq.^2j). We will also show that 
Eq.|S] immediately implies two inequalities which are closely related to the Clausius-Duhem 
inequality. In particular, Eq.[16| places a tight upper bound on the frequency with which 
finite-size violations of the Clausius-Duhem inequality do occasionally occur. We will finally 
generalize these results to processes in which the system of interest begins and/or ends in 
nonequilibrium statistical states. 

In the spirit (and level of rigor) of Gibbs JI| , we will work with the following quite general 
picture. The "system of interest" is a closed, finite system with a single external parameter, 
A. Additionally, we assume the presence of N other closed, finite systems, which will play 
the role of heat reservoirs. We will refer to these as "baths" , and assume that they have 
been prepared at temperatures T 1; T 2 , ■ • • , T N . Our thermodynamic process then consists of 
a sequence of steps during which the system of interest is placed in thermal contact with 
the baths, one at a time, while the value of A is varied along a pre-determined path A(t), 
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over a time interval < t < r. Let \ A = A(0) and \ B = A(r) denote the initial and final 
parameter values, and let n(t) identify the bath with which the system is in contact at time 
t. The functions A(t) and n(t) embody the macroscopic instructions (the "protocol") which 
specify the thermodynamic process. 

For any parameter value A and temperature T, there exists an equilibrium state (A,T) 
of the system of interest, described at the microscopic level by a canonical distribution in 
the phase space of the system. Through most of the paper (up to Eq.Q), we will restrict 
our attention to processes for which the system begins (t = 0) and ends (t = r) in such 
equilibrium states, denoted by A = (A A ,T A ) and B = (X B ,T B ), respectively. In other 
words, we assume that the system of interest is prepared in equilibrium: over the ensemble 
of realizations, the microscopic initial conditions of the system are distributed canonically; 
and that, at the end of the process, the system is once again described (statistically) by 
an equilibrium distribution: the microscopic final conditions of the system of interest are 
distributed canonically. Strictly speaking, these assumptions are mathematically suspect: 
there exists (to my knowledge) no rigorous proof that a canonical ensemble can be achieved 
in a finite time, with finite resources. Thus, one cannot say with certainty that there 
exist physically realizable methods for preparing a system in a canonical ensemble; or that, 
given a system initially in equilibrium, there exist processes which carry that system to a 
different equilibrium state in a finite time. However, it is a widely held prejudice that such 
processes do exist in Nature, and that the canonical ensemble is the appropriate statistical 
representation for a closed system in thermal equilibrium. We will therefore adopt the point 
of view that it is a legitimate exercise to assume initial and final equilibrium, and to explore 
the consequences of these (seemingly reasonable) assumptions, without concerning ourselves 
here with the separate problem of establishing the validity of these assumptions from first 
principles. Later, as mentioned, we will generalize to nonequilibrium initial and final states. 

We assume Hamiltonian evolution at the microscopic level. Let z denote a point in the 
phase space of the system of interest - specifying, e.g., the positions and momenta of all its 
constituent particles - and let z n denote a point in the phase space of the nth bath. Let 
y = (z, zi, ■ • ■ , z N ) then specify the instantaneous state of all degrees of freedom involved. 
Evolution in the full phase space (y-space) is governed by a time-dependent Hamiltonian 

N N 

H(y,t) = H m (z) + £ H b n (z n ) + £ S n>n{t) h^(z,z n ). (2) 

n=l n=l 

Here, H\{z) is a Hamiltonian describing the system of interest, for a parameter value A; 
H b is the Hamiltonian for the nth bath; and h 1 ^ couples the system of interest to that 
bath 0. TC(y,t) is (essentially) the most general classical Hamiltonian describing a system 
of interest, with a specified external-parametric time dependence A(t), coupled to iV other 
systems, one at a time. Once the initial conditions are fully specified, Hamilton's equations 
uniquely determine the evolution of all degrees of freedom. 

Let us consider a single realization of the thermodynamic process, described by a tra- 
jectory y(t) evolving under Hamilton's equations from some initial conditions y° = y(0), 
and ending at y r = y(r). Let E° and E T denote, respectively, the initial and final internal 
energies of the system of interest, and let AE n denote the net change in the internal energy 
of the nth bath: 

E° = H xA (z°) , E^ = H xB {z7) , AE n = H b n (zl)-H b n (z° n ). (3) 
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Now define 



E T 



n=l 



T 



(4) 



where T A and T B are the temperatures corresponding to the initial and final statistical 
states of the system of interest, and the T n 's are the temperatures at which the baths 
are prepared. Working with units in which Boltzmann's constant ks = 1, let us now 
compute (exp(— £)), where angular brackets signify an average over the statistical ensemble 
of realizations, i.e. over the ensemble of trajectories y(t). For a given realization, £ happens 
to depend only on the initial and final points of y(t): £ = £(y°,y r ). Since evolution in 
y-space is deterministic, we can formally express the final conditions as a function of the 
initial conditions, y r = y T (y°), and then compute the desired average over realizations, by 
integrating over the distribution of initial conditions, /(y°): 



(exp(-S)) = / dy /(y )expf-S(y°,y^(y 



(5) 



By our assumptions regarding initial conditions, /(y°) is a product of canonical distributions, 
hence we have 



exp(-S; 



mz a i d y ex p 



Nz 
z*_ 

Z A 



l^x J d y T ex P 



J^A 

E T 

J^B 



E» A H b n (z° n ) 

n=l ± n 



exp(— S) 



n=l 



T 



cxp 




(6) 



Here, Z A and Z B denote partition functions associated with equilibrium states of the system 
of interest, and F A and F B denote free energies: 



T i lnZ i = -Tin / dz exp[-H x ,(z) /T 



A, B. 



(7) 



J\f is the product of the partition functions for the N baths, each corresponding to the 
temperature at which that bath was prepared: J\f = Y\n=i I dz n exp[— H b (z n )/T n ]. In going 
from the first to the second line in Eq.|B], we have: (1) used Eq.|] to rewrite the integrand as 
an explicit function of y T alone, and (2) changed the variables of integration from y° to y T . 
By Liouville's theorem, the Jacobian \dy T /dy°\ = 1. 

At this point, Eq.[] is just a statement about energy exchange among a number of finite, 
closed systems, one of which has been singled out as being "of interest". Its validity does not 
depend on the relative sizes of these objects. To establish contact with more familiar results, 
let us now imagine the limiting case in which the heat capacities of the N baths become 
arbitrarily greater than that of the system of interest. The baths then assume the role of 
"infinite" heat reservoirs, and we can rewrite the term ^2 n /S.E n /T n in Eq.|] as — f B dQ fT: 



(During the time interval over which the system of interest is coupled to the n'th bath, the 
heat absorbed by the system is equal to the energy lost by that bath, so the value of / dQ/T 
over that interval of time is simply —AE n /T n .) Eq.^| now becomes: 



cxp 




exp 




(9) 



using the shorthand notation A(E/T) = E T /T B -E°/T A and A(F/T) = F B /T B — F A /T A . 
This is the central result of this paper. We add here that a result equivalent to Eq.^| has 
been derived independently by Gavin E. Crooks - using stochastic, Markovian dynamics 
to model the evolution of the system of interest - and that this result has been shown to be 
closely related to the Fluctuation Theorem for non-equilibrium steady states. 

Since internal energies are quantities associated with specific microscopic states (i.e. 
points in phase space), the exact values of E°, E T and dQ/T (= —^2 n AE n /T v ) differ 
from one realization of the thermodynamic process to the next. By contrast, the free energies 
F A and F B are associated with canonical ensembles of microstates of the system of interest. 
Thus, E = A(E/T) - J B dQ/T is a linear combination of quantities {E , E T , the AE n 's) 
which vary in value from one realization to the next, and Eq|] makes an assertion regarding 
the statistical distribution of values of E: it claims that the average of exp(— E), over the 
ensemble of realizations, is equal to exp[— A(F/T)], which depends only on the equilibrium 
states A and B, and not on the sequence of (nonequilibrium) statistical states through which 
the system evolves in getting from A to B\ Now, for macroscopic, reversible processes, it is 
well known thatfj 



[ B ^. = AS = S B -S A (REVERSIBLE), (10) 
J a T 

regardless of the path (through equilibrium state space) taken from A to B. Since Eq.|K] can 
be written, at the macroscopic level, as E = A(F/T) (because F = E — ST), our central 
result [(e _s ) = e~ A<yF / T ^\ may be viewed as the microscopic extension of Eq.|K] to irreversible 
processes. Moreover, and somewhat surprisingly, this result is valid regardless of how far 
the system is driven away from equilibrium between the initial and final times: no matter 
how violent the process, Eq.|9| will hold, provided the system begins in A and ends in B. 

For a given equilibrium state, the microscopic expressions for free energy, average in- 
ternal energy, and entropy satisfy F = E — ST, where the overbar denotes an equilibrium 
(canonical) average. Thus, the quantity which we have called A(F/T) can be written as: 

= J-J-A5=|l-^-A S , (11) 




1 Since quantities such as heat, entropy, etc., appear in both thermodynamics and statistical 
mechanics, and since these are (formally) separate theories, it is useful to distinguish between the 
two. Here and below, we use a carat (e.g. dQ) to denote that a certain quantity is to be understood 
in the macroscopic (thermodynamic) context, rather than in the microscopic (statistical) context. 
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where the second equality follows from our assumptions regarding the initial and final dis- 
tributions of microstates. Combining this with Eq.|^ gives: 




(12) 



This result expresses the entropy difference AS = S B — S A in terms of an arbitrary - in 
general irreversible - thermodynamic process from A to B. In principle, by repeatedly 
measuring E°, E T , and J^dQ/T for independent realizations of such a process, we can 
construct the averages appearing in Eq.[l2|, and therefore compute the value of 

We now derive, as a byproduct of Eq|| two inequalities, one old and one new (Eqsjnj 
and |X6| below), which are closely related to the Clausius-Duhem inequality By the convexity 
of the function e x , Eq.0 implies 



(13) 



E — ST, along with our assumptions of initial and 

■B 




Once again invoking the identity F 

final equilibria, (E°) = E and (E T ) = W , we can rewrite Eq.O 



as: 




< AS. 



(14) 



This result says, effectively, that the Clausius-Duhem inequality is satisfied "on average", 
where the average is taken over an ensemble of microscopic realizations of a given thermody- 
namic process. This still leaves open the possibility that there exist individual realizations 
for which the inequality is violated. We will now use Eq.|9] to investigate the frequency of 
occurrence of such violations. 

Macroscopically, the Clausius-Duhem inequality can be written as A(E/T)-j" dQ/T > 
A(F/T), or simply E > A(F/T). Thus, thermodynamics tells us that we will "never" 
observe a value of £ below A(F/T). To investigate the microscopic validity of this statement, 
let p(E) denote the distribution of values of £ corresponding to the statistical ensemble 
of microscopic realizations of a given thermodynamic process. Then the probability of 
observing a value of S no greater than some fixed value S is just: Prob[S < S ] = 
J^o?Ep(E). But Eq|] tells us that f^pe - ^ = e~ A< ^ F ^ T \ When we combine this with the 
inequality chain 



/ pe" E > I ° pe" s > e" So f ° p, 

J — CO J — CO J — CO 

and take E = A(F/T) — r , where T > 0, we obtain 

Prob[E < A(F/T) - T ] < ex P (-T /k B ) 



(15) 



(16) 



Note that Eq.12 generally involves averaging over infinitely many finite-time realizations, in 



contrast to Eq.10, which gives AS in terms of a single realization of infinite duration. 
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where we have explicitly put in the Boltzmann constant ks- Thus, the probability of observing 
a violation of the Clausius-Duhem inequality, by an amount no less than r , is bounded 
from above by e~ r °^ kB . A macroscopic violation would be one for which r /&B 3> 1, hence 
such violations are extremely rare: the Clausius-Duhem inequality is "never" violated by a 
macroscopic amount^. 

The previous two paragraphs are by no means intended as a first-principles derivation of 
the Second Law, as they assume - reasonably, but without proof - canonical distributions. 
Indeed, it has long been known (see, e.g. Ref. |IJ) that canonical ensembles imply inequalities 
such as Eq.[H], stating that the Second Law is not violated "on average" . (However, I believe 
that the upper bound given by Eq.[16| is a new result.) The aim here is rather to reveal the 
close connection between the central result of this paper (Eq.|9|) and the Clausius-Duhem 
inequality. 

While Eq.[| is valid for any thermodynamic process which carries a system from A to 
B, it is instructive to ponder limiting cases of such processes. We will now consider three 
examples, for which we will be able to verify Eq.^ directly (without invoking Liouville's 
theorem), by solving explicitly for E. 

The first example involves bringing a system - initially at a temperature T A - into contact 
with a reservoir at temperature T B , and allowing the system to relax to the temperature of 
the reservoir. Let us therefore imagine that, at time t — 0, we start with the system in the 
equilibrium state A = (A,T A ). Then, at t = + ("immediately after t — 0"), we place the 
system in thermal contact with a reservoir at temperature T B , and let the two equilibrate. 
We assume the reservoir to have the usual property of "infinite" heat capacity, so that the 
system of interest relaxes to the equilibrium state B = (\,T B ). In this situation, we get 
f A dQ/T = (1/T B ) f B dQ = (E T — E°)/T B - where the initial and final energies are given 
by E° = H\(z°) and E T = H\(z T ) - from which it follows that 



_ E T E° 



E T - E° 



H x (z°) H x (z° 



J^B 



J^A 



(17) 



We now average over realizations by integrating over the distribution of initial conditions to 
get: 



exp(— E) 



in agreement with Eq.||. 



1 



j dz° exp 


[ #a(z°)1 




j dz° exp 


#a(z°) : 


J^B 



exp 




exp(— E) 



(18) 
(19) 
(20) 



3 It is interesting to note the similarity between Eq.16 - which pertains to a nonequilibrium 
thermodynamic process - and the Einstein-Boltzmann expression for microscopic fluctuations of a 



system in equilibrium; see e.g. Ref. @, Eq. [112.1]. 
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The second example involves making a sudden change in the value of the external param- 
eter, X A — > X B , and then letting the system (assumed in contact at all times with a reservoir 
at temperature T) relax to the equilibrium state corresponding to the new parameter value. 
Thus, we begin (t = 0) with the system in equilibrium state A = (X A ,T), coupled to a 
reservoir at temperature T; a moment later (t = + ), we instantaneously change the param- 
eter value from X A to X B , and then we allow the system to relax to the equilibrium state 
B = (X B ,T). The initial energy of the system is given by E° = H x a(z°); the energy just 



after A is switched to X B is given by E 0+ 
Then /j 3 dQ/T = (E T - E 0+ )/T, and 



H x b (z ) ; and the final energy is E T = H x b (z 7 



E T 



EP_ 
T 



E 7 



from which we again get 



E 0+ H xB (z°) H x a(z°) 



T 



T 



T 



(21) 



exp(-E)) = / dz°exp 



H x a(z c 
T 



exp( 



exp 




(22) 



The third example combines these two, and gives us a specific prescription for carrying 
a system from one arbitrary equilibrium state to another. We start with the system in state 
A = (X A ,T A ). Then we instantaneously switch the parameter value to X B , after which we 
place the system in contact with a reservoir at temperature T B , and allow it to relax to the 
state B = (X B , T B ). Following steps as above, we get E = H x b(z°)/T b - H x a{z°)/T a } from 
which it once more immediately follows that (e~ E ) = e~^ F / T \ 

In each of these examples, a convenient cancellation of terms gave us the value of E 
explicitly in terms of known functions of the inital conditions of the system of interest (z°). 
For a more general thermodynamic process, in which more reservoirs are involved and A 
changes at a finite rate, this is not the case; if we wanted to compute E for a realization 
launched from a known set of initial conditions, we would need to actually integrate the 
equations of motion (in the full phase space) to get E T and J B dQ/T. 

Let us now suppose that we prepare the system in state A = (X A , T), and we switch the 
parameter at an arbitrary finite rate from X A to X B (driving the system out of equilibrium), 
while keeping the system in thermal contact with a reservoir at temperature T; at the end 
we hold A fixed at X B and allow the system to relax to B = (X B ,T). In this situation, we 
have 



B dQ 1 f B 
a -T=fh dQ 



-(E^-E°-W), 



(23) 



where W is the external work performed on the system by driving the parameter. We 
thus have E = W/T, and Eq|| reduces to the following relationship between the work 
performed (during realizations of this nonequilibrium process) and the free energy difference 
AF = F B — F A : 



1 f 
exp -- 



cxp I 



AF' 



(24) 



S 



Note the conditions for the validity of this result: there is only one heat reservoir^ and its 
temperature must equal that at which the system is initially prepared. Eq.^4] has recently 
been derived in a number of ways, and confirmed in numerical experiments ||. 

We now generalize our analysis to the situation in which the system of interest begins 
and ends in nonequilibrium statistical states. For instance, we might prepare the system by 
heating it at one end and cooling at another, until a steady-state thermal gradient is acheived. 
(The iV baths, however, are prepared in equilibrium, as before.) Whatever the method of 
preparation, let p°(z) denote the statistical distribution of initial conditions (of the system 
of interest) achieved by that preparation. Similarly, let p r (z) denote the distribution of final 
conditions; this will of course depend on the sequence of steps defining the thermodynamic 
process. 

As before, a realization of the process is described by a microscopic trajectory y(£), 
determined by the initial conditions, y°. For a given realization, let us define 

N A P 

T = -In p^) + In p°(z°) + E^ (25) 

n=l 1 n 

and let us compute the average of exp(— T) over our ensemble of realizations: 



(exp(-r)) = -l|rfy p (z )exp 



f g»(*°) 

n=l ± ti 



exp(-r) = 1, (26) 



following steps like those leading to Eq.|[ 

Since we were able to derive Eq.|l4] from Eq|| it is natural to wonder whether an in- 
teresting inequality can similarly be obtained from Eq.[26|. The convexity of e x in this case 
gives us — (r) < 0, or 

<lnp T (z T )> - <lnpV)> + (JdQ/T) < 0. (27) 

Now note that — (lnp°(z )) = — / p° In p° = Sg[p°], where the integration is over the phase 
space of the system of interest, and Sc[p } represents the statistical (Gibbs) entropy associ- 
ated with the initial statistical state of the system. Similarly, — (mp T (z T )) = Sa[p T ]- Eq.|27j 
then reads 

(/ dQ/T) < S G [pT] - S G [p°] = AS G . (28) 

That is, the expectation value of J dQ/T is bounded from above by the net change in the 
statistical entropy, So, characterizing the initial and final states of the system of interest. 
Note that in the case of an isolated system (no heat baths), this inequality reduces to a 
trivial result, as both sides are identically zero. 

Eq.^8]is equivalent to the statement: (r) > 0. Following a line of reasoning like the one 
leading to Eq.[TB|, we can use Eq.|26| to place an upper bound on the probability of observing 
a value of T no greater than — r : 



Or, if there are more, they share a common temperature. 
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Prob[r < -r ] < e' To/kB . 



(29) 



Thus, we will "never" observe a "macroscopically negative" value of V. Eqs.^6], |28| and ^9| 
together constitute a generalization of Eqs.|9|, and [16], to situations in which the system 
of interest begins and ends in states not necessarily corresponding to thermal equilibrium. 

A macroscopic, reversible process between two equilibrium states A and B has the prop- 
erty that A{E/T) - Xf dQ/T = A(F/T) {EqJ^. The central result of this paper is a 
microscopic, statistical generalization of this result to irreversible processes between two 

rB 

such states: (e~ A ^ E ^ + JA d< 9/ T ^ — e -M F /T) ^q^), where the average is taken over an en- 
semble of realizations of the process. In both cases, the right side of the equation depends 
only on the states A and B, and not on the (equilibrium or nonequilibrium) path connecting 
them. We have used Eq.|S| to derive an expression for the entropy difference between two 
equilibrium states, in terms of an arbitrary (generally irreversible) thermodynamic process 
connecting them (Eq{T^). We have also shown that Eq.[] leads to statistical statements of 
the Clausius-Duhem inequality, in particular placing an upper bound on the probability 
for observing violations of the Clausius-Duhem inequality above an arbitrary threshold To 
(Eq.[16p. Finally, we have extended this analysis to processes which begin and/or end out of 
equilibrium. 
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FIGURES 



FIG. 1. A schematic representation of the sort of thermodynamic process considered in this 
paper. The system of interest here is a gas inside a container, closed off at one end by a movable 
piston. The position of the piston is our externally controlled parameter, A. The three "heat 
baths" are simply objects with heat capacities much greater than that of the gas. The system of 
interest is brought into thermal contact with these baths, one at a time, e.g. as depicted by the 
filament connecting the bath at temperature T2 to the container of gas. At the same time, A is 
varied externally. 
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